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SYMMETRICAL STRUCTURAL PATTERN MATCHING 
CROSS-REFERENCE TO RELATED APPLICATION 

5 

Cross-reference is made to U.S. Patent Applications Serial No. 
09/AAA.AAA, entitled "Bi-Valuation Of Programming Statements" (Attorney 
Docket No. D/A0858Q), which is assigned to the same assignee as the present 
invention and incorporated herein by reference. 

10 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

15 The invention generally relates to pattern matching techniques in programming 
languages and in particular to a method and system for determining whether a 
computer-storable expression matches a filter. 

2. Description of the Related Art 

20 

Presently, several techniques have been developed for string pattern matching. 
The most fundamental underlying theory, i.e. that of regular languages and 
recognition automatons, has been widely applied in areas ranging from text 
processing to DNA sequence searches. Expressions describing string patterns 
25 are today still loosely integrated with general purpose scripting languages such 
as Python or Perl, because of their convenience for solving recurrent string 
related problems such as pattern extraction or replacement. 

With the increasing importance of structured information processing, and 
30 especially of complex structural transformations involved in data and document 
interchanges, the growing trend is to propose specialized query or transformation 
languages that strongly integrate pattern matching facilities. As long as complex 
structures are considered, e.g. trees or even graphs, language theorists and 
designers are again looking for expressive, powerful, simple, clear and precise 
35 formalisms in order to capture the most fundamental matching operations. 
However, the richness of complex data structures induces richer transformation 



-1- 



requirements, and general solutions for specifying general pattern matching at 
the right abstraction level have not yet been proposed. Such general pattern 
matching technique would however be required for application to a broad class of 
programming languages. 

5 

SUMMARY OF THE INVENTION 

Given the problems of the existing technologies, it would therefore be 
advantageous to provide a method and system that enable the specification of 
10 matching operations on various and arbitrary complex data structures while 
keeping the amount of basic building blocks reasonably small. 

It would further be advantageous to provide a pattern matching technique that is 
based on explicit and restricted assumptions, so that it can be embedded into 
15 existing or future, specialized or general purpose programming languages. 

Further it would be advantageous to provide a pattern matching method and 
system having underlying syntax and semantics defined on an unambiguous 
basis and within an extensible and flexible theoretic framework. 

20 

Moreover, it would be advantageous to provide an improved pattern matching 
technique of great simplicity and high expressive power. 

The present invention has been made in consideration of the above situation and 
25 provides a method, and article of manufacture therefor, of operating a computer 
system for determining whether a computer-storable expression matches a filter. 
A first code structure that represents the expression is evaluated for determining 
a value of the expression. A second code structure that represents the filter is 
analyzed for determining the characteristics of the filter. The first code structure 
30 is constructed from a plurality of first programming language code structure 
elements and the second code structure is constructed from a plurality of second 
programming language code structure elements, where each second structure 
elements corresponds to one of the first structure elements. The value of the 
expression is then filtered according to the determined filter characteristics. 

35 
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The present invention further provides a computer system capable of determining 
whether a computer-storable expression matches a filter. The computer system 
comprises processing means for evaluating a first code structure that represents 
the expression for determining a value of the expression, analyzing a second 

5 code structure that represents the filter for determining the characteristics of the 
filter, and filtering the value according to the filter characteristics. The first code 
structure is constructed from a plurality of first programming language code 
structure elements and the second code structure is constructed from a plurality 
of second programming language code structure elements. Each second 

10 structure element corresponds to one of the first structure elements. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings are incorporated into and form a part of the 
15 specification to illustrate several embodiments of the present invention. These 
drawings, together with the description, serve to explain the principles of the 
invention. The drawings are only for the purpose of illustrating alternative 
examples of how the invention can be made and used and are not to be 
construed as limiting the invention to only the illustrated and described 
20 embodiments. Further features and advantages will become apparent from 
the following and more particular description on the various embodiments of 
the invention as illustrated in the accompanying drawings, wherein: 

FIG. 1 illustrates a computer system according to the invention; 

25 

FIG. 2 is a general flow chart illustrating the pattern-matching technique of the 
invention; 

FIG. 3 is a more particular flow chart illustrating the pattern matching 
30 technique of the invention; 

FIG. 4 is a flowchart illustrating the evaluation statement process of the 
invention; and 
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FIG. 5 illustrates an example of the hierarchy of types in a programming 
language based on the techniques of the invention. 



DETAILED DESCRIPTION 

Referring now to the drawings and particularly to FIG. 1 , which illustrates a 
computer system of the present invention, processing means 100 is provided 
that is connected to an input section 110 and an output section 120. The 
processing means 1 00 can be of any type and has access to a program code 
storage 130 that stores the programming language statements and 
expressions that are operated on by the invention. The system further 
comprises in the example shown in FIG. 1 , a statement evaluation section 140 
and a pattern matching section 150 including instructions that allow the 
processing means 1 00 to operate as discussed in more detail below. 

GENERAL SYNTAX AND OPERATIONAL SEMANTICS 

Before going into the details of the invention, an example of a general abstract 
syntax for terms of the underlying language is provided, where the notation of 
e encompasses imperative and declarative statements. Operational 
semantics is described by using the SOS style described in G. D. Plotkin's 
article "A structural approach to operational semantics", Technical Report 
DAIMI-FN-19, Computer Sciences Dept., Arhus university, Denmark, 1981, 
considering "small step" transition in order to cover an eventual extension to 
concurrent languages with interleaving semantics. 

The first set of definitions is now provided that describe basic constructs that 
can be considered as universal. 

e ::= n | s | true | false constants: numerics, strings, booleans 

none | unit distinguished values 

e * e basic operations (*e {+, -, *, /}) 

if e-i then e 2 else e$ boolean choice 

var x = e.e variable declaration 

x variables 
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e ::=true | false 
e == e | e != e 



boolean literals 
equality and difference comparisons 



The construction for the introduction of local variables 
var x=e in e 

is often noted 
5 let x=e in e 

in functional language communities. 

More sophisticated computation structures, e.g. sequencing, loops and 
assignment, with widely understood semantics are described through the 
10 following grammar extension: 

e ::= e;e sequence 
x := e simple assignment to a variable 

*(e) closure computation 



A transition system describes an interpreter of the language through a 
transition relation which defines the computation of any expression e into a 

15 new expression e', and is noted e -> e'. Several computation steps such as e 
-> e' e" can be abbreviated by using the notation e — » e". By definition, 
terminating computations will reduce eto a normal value noted v which cannot 
be reduced anymore; this particular computation step is noted e -k> v, and a 
derivation chain that reduces to a normal value is noted e -»o v. The relation 

20 is formally described through: 

e-»e' e'-y+e" e e' ->(e' -> e") 

[norm] 

e -K> e' or e -*° * 



The formal semantics of basic boolean, string and arithmetic operations (noted 
★ above) will not be described here, being considered as widely understood. 

25 

The computing environment, as well as the use and notation of variables and 
references will now be described in more detail. The computing environment, 
noted S, is a mapping from names (of variables) into reduced values: 
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with xj being a denotation for the mapping of a unique label x i into a unique 
reduced value v,. Reference handling requires also another execution 
structure, a heap 

5 using the same notation provided that r denotes references. The introduction 
of recursive procedures or functions with non-lazy evaluation would simply 
require a stack of mappings in order to handle local environments. The entire 
environment H, S is sometimes abbreviated by r. 



In another notation, the computing environment is noted r as the mapping 
from variable names into reduced values: 

r = {arS,... ,x%) 

Further, T,x v is an abbreviation of H,Sv{x v }, or ru{x v }, respectively, and 
similarly r, r v is an abbreviation of H u {r v }, S. The transition relation 
becomes now The -> T'be' in the general case, although invariant execution 
structures can be skipped for clarity when required. This relation means 
"expression e computed in environment H, S becomes e' in environment 
H',S'", understood that W and S' can be equal to or different from H and S. 
The following equations describe the semantics of variable access [var] and 
declaration [d1 ,d2]: 

T,x v t-x-+T,x v \-v [var] 
r I- ei T' h e[ 



raj = ei.e 2 -J-F H varx = e[.e 2 
rhe^o T h v 



[dl] 



T h \ar x — e 1 .e 2 -+ T, x v h e 



[d2] 



Reference creation and dereferencing involve intermediate distinguished 
25 values r (references) on which no other operations are defined, as opposed to 
pointers and pointer arithmetics. 

r\-e-+T'he' rhe-s-r'he' 
r(-@e->Fh@e' LreflJ THe-±T'\-\e> [drefl] 

r I- @u ~> T, r v h r [ref2] T, r v Hr -+T > r v \- v [dref2] 
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In [ref2], it is to be mentioned that a new unique reference r is created in the 
Heap and that this reference is returned as result of the computation of @v. 

In the testing operation, environment modifications are allowed during 
5 evaluation of the boolean part. This enables the use of a matching operation 
as a condition for the test. 

r| - e i-> r ' he 'i [if| 

T h if ei then e 2 else e 3 -> V h if e\ then e 2 else e 3 

if true then e 2 else e 3 e 2 [ifl] if false then e 2 else e 3 -+ e 3 [if2] 

The semantics of the basic numerical operations +, /, *, - is well known in the 
10 art. The + operator is polymorphic, i.e. it applies in various semantics to 
numerals, strings, sequences, concatenations, multisets, disjunctive unions, 
i.e. m 1 +m 2 -m 2 =m 1 , and dictionaries (non-commutative, right priority). 

PATTERN MATCHING 

15 

The pattern matching technique, which will now be described in more detail, 
evaluates a first code structure that represents an expression, analyzes a 
second code structure that represents the filter to be matched by the 
expression, and filters the value determined by evaluating the first code 

20 structure according to filter characteristics determined by the second code 
structure. The first code structure, hereafter denoted "data structure" and the 
second code structure, hereafter denoted "pattern structure", are constructed 
symmetrically so that matching operations can be specified on various and 
arbitrary complex data structures, such as strings, sequences, sets, 

25 dictionaries and records, but also on trees, DAGs (Directed Acyclic Graphics) 
and general graphs. This will be shown in more detail hereafter. 

In the following, it is assumed that it is possible to declare local variables which 
will potentially be assigned to parts of or to the entire filtered structures. 
30 Expressions, such as e, e i can be literal constants, variables or basic 
operations, such as e + e, e*e. References are considered because they 
allow the sharing of substructures and the modeling of DAGs and graphs. 
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Pattern matching operations make it possible to check a given expression e for 
whether the expression contains a structural pattern, and to extract a part of its 
content, in a single operation. A pattern matching operation is made up of 
three parts: The first part is an expression e against which the filter is to be 
5 checked. This part is called the subject. The second and third parts are the 
pattern-matching operator # and the filter /. The subject can be a variable, a 
constant, or a more complex expression that will be evaluated prior to 
matching. 

10 Thus, a pattern matching operation looks like 

e#f. 

These operations return a boolean value. If the operation succeeds, meaning 
that the expression matches the filter and, optionally, that variables have been 
15 assigned to a part of the subject's content, then it returns true. If it fails, 
meaning that the expression did not match the filter structure or that it did not 
contain a given value, then false is returned. 

By convention, normal values are noted i/or n, s if they are numeric or strings, 
20 respectively. As shown above, a derivation chain that reduces to a normal 
value is noted e — »o v. The general semantics of the matching operation e # f 
requires in the following order: the evaluation (step 300 in FIG. 3) of the left 
operand e (normalized to v), the evaluation (step 310) of the right operand, i.e. 
the filter /, and the application (step 320) of the filter to the normalized value, 
25 which returns either true or false. It will be appreciated that the term "value" 
does not necessarily relate to a numeric value as the expression may be a 
non-numeric expression. Moreover, the environment might be modified by the 
matching operation, whatever result is obtained. Normalized filters are noted 
as bold letters. The formal semantics of matching operation is twofold. The 
30 first stage computes a reduced form first for the subject ([matchl ] iterated) and 
then for the filter ([f-match1] iterated): 

rhetz-nvhe'tt/ [matchl] T^vtf-^ry-vtr [f - matchl] 
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The last stage, i.e. the filter application itself, depends on the filter and data 
structure considered and will be defined case by case in the following. 

Examples of structure constructors are now presented in order to illustrate the 
5 symmetry between them and the corresponding filter constructors described 
below. The structure constructors and filter constructors are indicator 
elements indicating the respective data type: 



{<?! , e 2 , ...} Multiset: a collection type in which 

elements are not ordered and which can 
contain multiple instances of the same 
value 

[ ei t e2 1 ..J Sequence: an ordered collection of 

elements of a common type 

(e 1 , e 2 , ...) Tuple: an ordered collection of elements 

which has a fixed size. Elements need 
not be of a common type 



name! =e lt name 2 



Record: an unordered collection of 
named elements 



{key! = e x , key 2 = e 2 r ...} Dictionary: an unordered collection of 
elements that are each accessed by a 
key. Each key must be unique 

@ (e) References: a reference to a value (itself 

computed from an expression e) stored in 
memory 

! De-referencing operator, used to access 

a referenced value 

Further, there is provided a + operator that can take different semantics 
depending on the data structure, e.g. arithmetic addition, string concatenation, 
set union, etc. 
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Filters are expressed using a small number of operators and can describe 
many different structures. Besides this, filters closely resemble the structures 
to be matched, making them rather easy to specify. Filters can match 
5 sequences, multisets, tuples, records, dictionaries, strings and any 
combination of these structures. All filters are built using three basic filter 
operators, in addition to filter constructors which use the same notation as their 
data constructor counterparts. The three basic filter operators are the test 
operator, the existence operator and the assignment operator. 

10 

The test operator, noted % in the present example, is used in conjunction with 
a constant, variable or complex expression, which will be evaluated prior to 
matching. It tests the occurrence of the vaiue given by its operand at some 
point in the structure. For instance, 
15 e # %' circus' 

tests whether e is a string equal to 'circus' or not. 

e # [%(2+2) ,%3] 

checks that e is a sequence having one item of value 4 and one item of value 
20 3 in that order. 

The existence operator, noted ?, is defined as 'match any element'. For 
instance, 

e # <?,?> 

25 matches any tuple that has exactly two elements, like 

< ' circus' , 47> . 

The assignment operator, noted ?x, where x is a variable name, is used to 
extract a part of the subject and assign this part to x. For instance, 

30 e # <%' circus' ,?, ?y> 

will succeed if e is a tuple containing three elements. The first element has to 
be the string 'circus', the second one can be anything, and the value of the 
third element is assigned to variable y. The same pattern matching operation 
on a sequence would be very similar: 

35 e # [%' circus' ,?, ?y] 
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changing only the constructor from tuple to sequence. 



In addition to these basic filter operators, there is provided a concatenation 
operator, noted ++, that combines compatible elements. It can be seen as the 
5 dual operator of the concatenation operator (noted +, see above) of data 
structures. For instance, the string 'circus' can be thought of as the 
concatenation of three substrings 

' ci' +' r' +' cus' . 



10 In a symmetrical way, the filter appears as 

e # % 'ci' ++ %'r' ++ %'cus'. 



For finding strings containing character 'r\ the filter 

? ++ %'r' ++ ? 

can be used, which means zero or more elements, plus the letter 'r', and a 
further zero or more element. This operator can be used with any structure, 
making it possible to take other elements into account. For instance, e # [?x] 
matches only sequences consisting of exactly one element, and assigns this 
element to x. To express the fact that a sequence e must contain at least one 
element, without any ordering, ? combined with the ++ operator can be used: 
e # ? ++ [?x] ++ ? . 



For illustrating the advantages of the present structural pattern matching 
scheme, more complex examples are now given for strings, tuples, 
25 sequences, records, multisets and dictionaries. 

e # ? ++ %'r' ++?x 
will match any string containing V and assign the substring beginning after the 
first occurrence of V to variable x, if e='circus', then x will be assigned 'cus' ; if 
30 e='red', then xwill be assigned 'ed'. 

e # [<fl=?x>] ++ ? 
will match any sequence containing one record as the first element. This 
record must contain a field f1; the value of this field will be assigned to variable 
35 x. 
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[<fl=10>,<f2='s'>,<fl=3>] # [<fl=?x>] ++?y 
will succeed; xwill be assigned 10 and y will be assigned [<f2='s'>, <f1=3>]. 



5 e # {? ++ [<?, ?x>] } ++ ? 

will match any multiset containing at least one sequence whose elements are 
tuples made up of two elements and will assign the second element of the last 
tuple of a sequence in this multiset to variable x. It will select the last tuple of a 
sequence because the pattern structure includes ? ++ [<?, ?x>] instead of 

10 [<? , ?x>] ++ ? which would have selected the first tuple. 

{'ab', 'cd', 'ef'} # { % ' ef ' , %' ab' , %' cd' } 

will match since the order is irrelevant in sets. 

15 Pattern matching can further be used to retrieve values from a dictionary. 
Suppose a dictionary which maps some strings to some sequences, 

diet # {'kl'=?} ++ ? 

will succeed if diet contains a key 'k1', and 

diet # {'k2'=?x} ++ ? 
20 will succeed if diet contains key 'k2' and will assign the corresponding 
sequence to variable x. 

Since pattern matching operations return boolean values, they can be 
composed using logical connectors. It is then possible to express filters which 
25 succeed only if the subject does not match the filter, or complex filters. There 
are three composition operators, "not", "or" and "and". 

"not" will succeed if the subject does not match the filter. For instance, 

e # not (? ++ %'r' ++ ?) 
30 will succeed only if string e does not contain the character Y. 

"or" takes two filter arguments, which are matched from left to right. For 
instance 

e # %'c' ++ ? or ? ++ %'r' ++ ? 
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will succeed only if string e begins with the character 'c' or if it contains the 
character Y. 

"and" works in a similar way as "or". It succeeds if the expression matches 
5 both filters. For instance, 

e # <?,?> and ?x 
allows checking that e is a two-element tuple and assigns e to x. 

There are also provided "Kleene" operators * and + that work with the known 
10 semantics, "zero or more elements" and "at least one element", respectively. 
For instance, 

e # %'abb' ++ (%'C)* ++ %'dee' 
will match any of the following strings: 'abbdee', 'abbcdee', and 'abbcccdee'. 
The same filter using the second operator, 
15 e # %'abb' ++ (%'c') + ++ %'dee' 

will match the same set of strings except 'abbdee'. The Kleene operators can 
be used with sequences, sets and dictionaries. 

As shown above, the described pattern matching technique enables the 
20 symmetrical constructions of both pattern matching structures and data 
structures, so that they reach the same arbitrary level of structural complexity. 
Further, the matching operation is invoked explicitly, through a dedicated 
operator. The general form of the structure to be matched is tested as well as 
the contained (sub-)structures and the assignment of part(s) of the matching 
25 structure to variable(s) of the execution environment. 

The technique relates to a number of fields including those of language 
construction, control abstractions and transformations models, rewriting 
systems theory, term rewriting systems, transformation languages or systems 
30 for compilation and language processing, structured document transformation, 
tree pattern matching, explicit or automatic document transformation systems, 
and so on. 



Further, the technique may serve for building transformation models which are 
35 less abstract and more general, than rewrite systems, which perform implicit 
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pattern matching and apply built-in strategies for rule application. The 
technique is on the other hand abstract enough to simplify and extend general 
purpose programming languages. Thus, the technique may play an important 
role in the design of new transformation techniques or the extension of existing 
5 ones. 

Four basic topics are addressed in a single approach different to and 
independent from existing ones that are currently and conceptually less 
efficient: the definition of a data model, the definition of matching operations, 
10 the definition of a transformation model, and the integration of the 
transformation model in a programming language. 

The definition of a data model is to give a precise form to the notion of data 
structures, which need to be rich and clear for the programmer but at the same 
15 time kept as simple as possible. The computational properties of each kind of 
structure should be stressed to reach completeness at minimal cost. For 
instance, sequences are ordered structures that are useful for handling stacks, 
fifo's, or to memorize intermediate nodes when walking through a tree, 
whereas multisets are useful for managing "bags" of unorganized data. 

20 

The technique described above proposes a "universal" data model based on a 
synthesis of the most commonly used data types. These are chosen in order 
to avoid redundancy and to enable the construction of heterogeneous 
structures of arbitrary complexity while being kept simple and explicit. 
25 However, applying the technique does not require using exactly the proposed 
type set, but only applying the symmetrical construction principle, both to data 
structures and to pattern structures. 

The definition of matching operations is clearly related to the previous point. 
30 This covers three fundamental issues: identifying and testing the "form" of the 
structure, (step 200 in FIG. 2); check the value of the structure (or a part of it) 
(step 210); and extracting a part of the information stored in the structure (step 
220). 
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The technique allows for building pattern matching structures in such a way 
that the required form is made explicit, thus clear to the programmer who 
specifies it. Parts of the subject structure which are not of interest are 
abstracted through a basic existence filter noted "?". Values inside the 
5 structure can be checked as equal to arbitrary complex values, thanks to a 
basic testing filter noted "%", e being a potentially complex expression. 
Finally, information located in the subject structure can be extracted and 
copied to any variable that is available in the execution environment, by using 
a basic assignment filter, noted "?x", where x is a variable name. 

10 

The definition of a transformation model starts from the finding that matching 
operations are just intermediate steps of realistic structure transformation 
processes and should therefore be put in a more general context: How are 
transformation steps described, chained and ordered? How are structures 
15 scanned and what is the result of the overall transformation? How is the 
contextual information extracted that is used during matching operations: is it 
simply transferred into the output structure(s) and/or does it drive the 
transformation itself? 

20 The explicit invocation of the matching operation, according to the present 
technique, allows one to see it as a boolean evaluation. The transformation 
model can therefore take an useful form, depending on the requirements. The 
transformations can cascade matching operations by using rules like # fi 
e 2 # f2 => or composed sequentially or through complex networks of "if- 

25 then-else" statements, possibly comprising computation on the extracted 
context. Output structures, the result of the transformation, are constructed in 
a coherent way by using the available data models and contextual information, 
possibly transformed by other computational means. 

30 Depending on the definition of the transformation model and the expected 
computational power of the transformation, one can consider either to extend 
the pattern matching with language constructs to specify internal computation, 
as a complement to matching operations, or to integrate the transformation 
model itself into a more general programming language, as an extension 

35 which increases expressiveness. Both options are made possible by this 
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technique, thanks to the explicit matching operator and the few general, and 
modular, assumptions regarding the underlying language. 



Considering the above observations, it will be appreciated that the described 
5 pattern matching technique is in particular suited for supporting general typing 
mechanisms. Type checking improves the global reliability of programming 
languages, and provides efficient means for runtime optimization. 

Pattern Matching Syntax and Operational Semantics 

10 

As noted above, the general abstract syntax uses e for expressions and Hor 
pattern matching filters. Matching operations are invoked through the operator 
e # f where the left expression e is the subject and the right operant f is the 
filter or pattern. 

15 

There are provided four basic operators plus combinators (or filter connectors): 



f ::= ? existence test 

?x existence test and assignment to variable x 

o/ oe equality check 

@ f ref. filter 

f ■■- f ++ f filter composition 

f | f kleene-like operators 

/and f I f or f I not / boolean (ordered) connectives 



The first two filters ? and ?x are under normal form. The computation of the 
equality check and of reference filters requires the computation of their 
embedded expression: 



By using a meta symbol * e { ++, and, or }, we define a family of equations 
25 valid for all binary combinators: 

- , [f-left] ,J?Z?*r [f " right] 
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a 
.... 



The reduction of the kleene-like operator f* preserves the structure of the filter 
(if]) whereas the computation of f + is a pure rewriting ([f]): 

In the semantics of filter application (matching), v and w denote reduced 
terms: 

v t ? -» true [m-fi:ee2] I\ x v h w ft ?ar -5- T, x w h true [m-freel] 

r^hvitf-^r'^i-true « 1 = t, 2 -> true/false 

r, r" h r | Of -5- F, r" h true L J ©i | %« 2 true/false 

It is to be mentioned that [m-%] uses again the structural equality on 
structures. This last is defined for all considered structures as s ? = s 2 iff s 1 c s 2 
and s ? 3 s 2 . The inclusion itself is straight forward for strings, sequences and 
multisets; for dictionaries, it corresponds to the inclusion of key/value pairs. 

The composition combinator ++ applies only to strings, sequences, multisets 
or dictionaries. It can be abstracted over these various data structures, noted 
s, by using the + operator which models concatenation for strings and 
sequences, disjoint union for multisets and non-commutative union for records 
and dictionaries. As keys must be unique in a dictionary, the key/value pairs 
of the right hand operand override the key/value pairs of the left hand operand, 
if required. This does not impact the semantics of the related matching 
operation. The following definition uses again the equality relation on 
structures: 

[m-faddl] 

3si,s 2 \s 1 + s 2 = s giftfi true s 2 j f 2 -* true 



Vsi , 52 such that si + s 2 = s < 



Sl jtfi-» false 
s ft f x +rf,-> false 

«xtfe-Mn» ..ift-* false 

s | f 3 ++f 2 -J- false 1 1 
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Similarly, in the following definition which applies only to strings, sequences, 
sets and dictionaries, the term e is an abstraction over empty string, empty 
sequence, empty set and empty dictionary: 

[m*] 

if s £ £ 3s 1} s 2 I s = Sl +sz aijjf-Hrue s 2 jtf*-»true 
s D f * -» true 

e j f * -» true [m*b] 



In the following equation, the order of operands is important, and computing 
environments can be altered by unsuccessful operations. This enables more 
efficient implementations since no specific processing is required in order to 
preserve the original environment: 

[m-andl] [m-and2] 
r I- v fl f ! -» I* I- true rj-ttftf 2 -»r"htrue T h v j f j -> F I- false 

r h v Jt fi andf 2 T" h true r h v ft fi andf 2 -» T' h false 

[m-and3] 

r I- v ft fi ->• r h true F h p | f 2 -» F' I- false 
T h t; | ^ and f 2 -^r"h false 



A similar behavior is defined for "or" filters: 

[m-orl] [m-or2] 
T h t; 8 fi F h true r j- t> I fi -» F h false I* h tt | f a -> F' h true 

r h v # f a or f 2 -j. F h true r h u j f x orf 2 -> F' I- true 

[m-or3] 

r h t> j f a F h false F h p ft f 2 F' h false 
wf fx or f 2 -*r"h false 



Similarly, the "not" filter is 

_r 

r I- v not f a -> F h false/true 



r h v f fi F I- true/false 

[m-notj 



Of course, backtracking might be convenient in cases where the matching 
failed and still let the environment changed. Further, a solution by the mean of 
an explicit restoring operation v(f), may have semantics 

j±f ffv1 rh.jtf^r'r-true r h v j f -» r I- false 

v(/)->v(/') [f ' v] rhvSv(f))->r'htrue [mVaJ rh^V(f)->ri-false l J 
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The symmetrical construction of data and filter structures will now be 
described in more detail in the examples of tuples, sequences, multisets, 
dictionaries and records. 



5 Tuples allow to handle heterogeneous structures of fixed length. The present 
description will present only constructors. Other common operations on tuple 
structures are: access to items through indexing notations such as /[/], in order 
to fetch the / h item, or assignment /[/] := e, in order to set the / h item, provided 
that / corresponds to the actual size of the tuple. Tuples are particularly useful 

10 for computing cartesian products such as done in relational algebra and 
related languages: 

e ::= (e 0 , e k ) tuple construction (k+ 1 items) 

/ ::= </o, /k) filter for tuples of /e+ 1 elements 

In the following part, e is noted as a shorthand for e 0 , e k . The computation 
15 of a tuple (or a filter tuple) is defined by the successive computation of all 
subterms, in the order of occurrence. A tuple or filter tuple is reduced when all 
subterms or sub-filters are reduced: 

<„,..... eliHt 4 » * AH n 

20 Matching for tuples is performed by matching all subfilters to corresponding 
substructures. If the subject v is not a tuple, or if cardinalities are different, the 
operation returns "false" ([m-tuple]): 

ri-,offo-+rW|-true ... r^h^f^rWhtrue 

r h <««,, ... & <*>. — - f *> -* r(fc) H true 

25 It is to be mentioned that potential modifications of execution context are 
propagated through the whole matching process. 

Sequences, multisets and dictionaries are defined as shown below: 

e ::= [e 0 , e k ] I {co.---.ek} (ordered) sequences, multisets 
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{e 0 = e 0 ', e k =e k '} dictionaries (unordered key/value pairs) 

[] | {} | {=} empty sequence, multiset, dictionary 

: [/o> ---'/J I ifo< ■■■> /*} sequence/multiset filters (k > 0) 

_ y t _ y^' } dictionary filters (k > 0) 



[uo,- 



[fo,. 



[f-seq] 



5 Equivalent equations for sets, called [set], [set2], [f-set] and [f-set2], are strictly 
similar to the previous one: 

fa,...,*,...,*}^,....^....*} ^ {f 0 , ... ,/;, ...,/}-> {f 0 , .-.,//,-.., /*} ^ 



When matching sets & 0M] denotes the set {v 0 , v k } and SF 10 * 1 the filter {f 0 , 
io fc}. If / e [0,/c], the S 10 '^ 1 is equivalent to {i/ 0 , v h1 , v i+1 , v k }, and similarly 
for s/ d0,kHi} . Using this notation, the matching over sets is recursively defined 
as: 

r h 51°.*! j SFl°M -> T" h true [m " S6t] 



15 This equation does not express any ordering in exploring the search space. It 
just requires that each value in S matches a corresponding filter in SF. Note 
that the computing environment can be modified throughout matching 
operations. 



20 Dictionaries are computed by successive evaluation of key/value pairs, 

following the occurrence order: 

e i -» «ff fdicl 

{v 0 =v' 0 , ... , ei=e'i, ... , e k =e' k } -» {v 0 =v' 0 , e<'=e<, . . . , e k =e' k } 1 1CJ 



{wo=«o> ■ - > Vi^i, ••• , e k =e' k } -> {uo=vd> • • • > "i=e", • • • , e k =e' k } 



Tr [^2] 
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Computation of filter dictionaries is strictly similar, and therefore, 
corresponding equations [f-dic], [f-dic2] will not be shown here. 



When matching dictionaries, cP' k] denotes the dictionary {v 0 =v 0 ', v k = v k '} 
5 and Df* 0 * 1 the filter {f 0 = f'o, ...,k= f'kY Using this notation, the matching over 
dictionaries is recursively defined as: 

{Th vi%tf ->■ r'htnie 
T'h »<fft r"htrue 
T" h D&M-ii) i DF loM-m _> T >" h true 

r h £>C°. fc 3 ft DFl°M -> T'" h true [ C] 



This equation does not express any ordering in exploring the search space. It 
10 just requires that each key/value pair matches a corresponding filter-key/filter- 
value pair. Note that the computing environment can be modified throughout 
matching operations, and that keys are matched prior to values. 

Records are unordered and heterogeneous collection of values which can be 
15 statically designed by a name called "member". Standard operations on such 
data structures s are member access, e.g. a := s.m, or member assignment, 
e.g. s.m := 10. Record provide useful mnemonics in order to select a part of 
complex structures and are well known for their expressive richness in data 
modeling: 

20 

e ( m(j = e 0 ,..., m k =e k ) records (unordered member-name/ 

value pairs) (k> 0) 

/ :: = (m 0 =f 0 ,...,m k =f k ) record filters (k> 0) 



The reduction of data and filters follows the order of occurrence: 

e, -> e'j 

(m 0 =«o> • • • . wif=e a -, • • • , m k =e k ) -> (m 0 =« 0l - • • , m i= e i. - • • > ™ k =ek) 



[e-rec] 



Filter records are similarly defined: 
fi 



(m 0 =fo, • • • , mi-fi, ... , m k =f h ) ->• <m 0 =fo, • • • , "»»-//, • • • , ™k=fk) 



[f-record] 
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Matching is not order sensitive, i.e. the ordering of filters can differ from the 

ordering of the subject, but filters are applied through their definition order. 

Member names must be exactly identical: 

3 distinct i 0 , . . . , i* £ [0 • • • k] such that 
f m' 0 = m io and T H v io ft f 0 r« h true 



{ m' k = m ik and j- ft f fe -> !<*> j- true 

T P <m 0 =a 0 , . . . , m k =v k } ft (m'o^fo, . . . , m' k =f k ) IW h t 



• [m-record] 



The matching fails if one of the sub-matching fails: 

3 distinct i 0) . . . , ij € [0 • • • k], j < k such that 

{m' 0 = m io and r h v io f f 0 ^ T« h true 
m^. = m i: and rO'- 1 ) h ^ ft Sj -» £C?j I- false 
F h (m 0 =«o, ■ • • , m fc =v fe ) I (m' Q =f 0 , m' k =f k ) -> TO') h false 



[m-record2] 



=p io Recursive Filters 

Recursive filters and the "do" operator will now be described in more detail. 

Recursive filters enable the filtering of trees. For instance, 

e # rec F= <% ' plus ' , F, F> or <%' minus ', F , F> or <?> 
succeeds if e is a tree with nodes that are labeled by strings 'plus' and 'minus' 
and with leaves that are tuples containing a unique element (of any structure). 

The "do" operator takes a filter as the left argument and an instruction (or 
20 sequence of instructions) as the right argument. Instructions are executed 
only if the filter is successful. 

For instance, 

e # <%12,?> do i:=i+l 

25 increments / only if e is a tuple made of two elements, the first one being 12. 
This operator can be particularly useful in recursive filters. 
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Using "do" it is possible, for instance, to extract all the numbers from a tree 
based on the previous example and append them to a list n. The extend filter 
A is 

rec F= <%'plus' ,F,F> or <% ' minus ' , F, F> or (<?x> do n:=n+[x]) 

5 

In a basic example such as 

<'plus' , <'minus' , <1>, <2>>, <4>> # A 
where the tree encodes (1-2)+4, the pattern matching operation succeeds and 
n is equal to n+[1 ,2,4] after application. 

10 

The syntax and operational semantics of recursive filters and the "do" operator 
is described hereafter: 

f::=recF=f | F recursive filter and recursion variable 

::= f do e "do" operator (e is executed if f matches) 

15 As described above, these filters are reduced by preserving their structures. 
Reduction of the "/do e" filter differs from reduction of the "%e" filter because 
the embedded expression e is not computed. It will be evaluated in the 
context of the matching operation, and only if required: 

[e-recl IslL r e -do] 

20 

Recursive matching is defined by using a substitution operation, as e.g. in the 

standard p-reduction of the lambda calculus: 

rhjjj f[rec F = t/F] -» I" \- true/false 

T\-vinxF = f^T'\- true/false Lm_rccJ 

25 In the following [m-do], the evaluation of e is done only if the filtering operation 
is successful. In that case, the new context is used, thus allowing side-effects 
such as the memorization of useful intermediate information: 

r j- v jt f -» I" h true I" I- e -»o F" h w TI-vjJf^-r'Hfalse _ 

rh«tfdo e -^r«htrue tm - d0j rh^Sfdoe-j-Phfalse [m - d ° 23 
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For illustration purposes, the technique described above is now applied to an 
example of managing a database of book references. The data is stored in a 
Set structure (unordered collection of records) describe hereafter. 



const DBase = { 

< year = ' 1994 ' , 

title = ' TCP/IP Illustrated', 

author = [ < last = 'Stevens', first = 'W.' > ], 
publisher = ' Addison-Wesley ' , 
price = 65.95 

> , 

< title = 'Advanced Programming in the Unix environment', 
year = ' 1992 ' , 

author = [ < last = 'Stevens', first = 'W.' > ], 
publisher = 'Addison-Wesley' , 
price = 65.95 

< year = ' 20 00 ' , 

title = 'Data on the Web', 

author = [ < last = 'Abiteboul' , first = 'Serge' >, 

< last = 'Buneman' , first = 'Peter' >, 

< last = 'Suciu' , first = 'Dan' > 

] , 

publisher = 'Morgan Kaufmann Publishers' , 
price = 39.95 

>, 

< year = ' 1999 ' , 

title = 'The Economics of Technology and Content for Digital 
TV , 

editor = < last = 'Gerbarg' , first = 'Darcy', affiliation = 
'CITI' >, 

publisher = ' Kluwer Academic Publishers', 
price = 129.95 



Now, examples are given to extract, filter and recombine book information by 
using the filtering primitives and structured pattern constructors. 

40 For finding all books from Addison-Wesley that are published between 1 990 
and 1999, and for storing the titles, a recursive function F1 is defined that also 
returns the result in a Set: 



function Fl (x) is 
45 if 

x#{ < title=?t,publisher=%'Addison- 
Wesley' ,year=%' 199' ++? > 
++?}++ ?y 
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then 

return Fl (y) + { < title = t > } 
else 

return { } 

If F1 is called with the book database as parameter (written F1 (DBase)) the 
result is 

{< title = 'Advanced Programming in the Unix environment' 
< title = ' TCP/IP Illustrated' >} 

The rest of the information is not return in the result, e.g. the authors. The 
following variation, which is also perhaps more legible, does this job: 

function Fl (x) is 
if 

(x#{?book} ++ ?y) and 

(book#< title=?t , publisher=% ' Addison- 
Wesley' ,year=%' 199' ++? > 
+ + ?) 
then 

return Fl (y) + {book} 
else 

return { } 

This last example shows the interest of having explicit filtering operations: the 
first application is done on the parameter x and the second on "book". The 
equivalent solution below shows the interest of the "and" filter; the previous 
"and" is just a standard boolean connective. 



function Fl (x) is 
if 

x#{ 

(< title=?t,publisher=%'Addison-Wesley' ,year=%' 199' ++? 
> ++ ?) 

and ?book 
}+ + ?y 
then 

return Fl (y) + {book} 
else 

return { } 

For finding all publishers known in the database, the filters are used in another 
construction: the "for" loop, has for instance the following syntax 

for f in el do e2 
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where f is a filter, e 1 a computable expression that evaluates to a Set or a 
Sequence, and e 2 any programming statement. This loop applies the filter to 
all elements of the Set/Sequence, and if successful, executes e 2 . The solution 
is then: 

for <publisher=?p>++? in DBase do (R := R+{p}) 

This result of this program is found in R, with R being supposed to be empty 

before the execution: 

R={ ' Addison-Wesly' , 
' Addison-Wesley' , 
'Morgan Kaufraann Publishers', 
' Kluwer Academic Publishers'} 

As can be seen, the Addison-Wesley publisher is repeated twice. One might 
want to have a real "projection" of the information, and for that, can use an 
additional filter: 



for <publisher=?p>++? in DBase do ( 
if not (R#{%p}++?) then R:=R+{p} 

20 ) 

The result of this program is as expected: 

R={ 'Addison-Wesly' , 

'Morgan Kaufmann Publishers', 
25 'Kluwer Academic Publishers'} 

For finding all authors having last names that begin with 'A', the following 

construction can be used: 

for <author=?s>++? in DBase do ( 
30 for <last= (%' A' ++? and ?auth) >++? in s do ( 

if not (R#{%auth}++?) then R := R+{auth} 

) 

) 

35 The result will be {'Abiteboul'}. 



It will be appreciated that the presented pattern matching technique is suitable 
for either designing programming languages specialized in data structure 
transformation, or for facilitating extensions to existing languages in order to 
handle such transformations. The construction of data structures and pattern 
matching structures, i.e. filters, of arbitrary complexity uses symmetrical 
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constructors, thereby allowing for great simplicity. The definition of basic 
filters, structured filters, recursive filters and logical combinators provides any 
programmer with means that have a high expressive power and a good level 
of simplicity. A boolean operator is provided that allows to apply explicitly the 
5 pattern matching structure to the subject data structure. Further, a formal 
operational semantics is provided that defines precisely the nature of filters 
and of the matching operation as well the relationship with any associated 
computational model. Moreover, this formalization offers a flexible theoretical 
framework that can help further integration. 

10 

BI-VALUATION OF PROGRAMMING STATEMENTS 

By means of the statement evaluation section 140, the computer system can 
=p perform the process which is depicted in FIG. 4. A programming language 

15 statement may include a first and a second sub-statement. In step 400, the 
M- first sub-statement is evaluated, and depending on the decision in step 410, 

the second sub-statement may likewise be evaluated. As will be shown in 
O more detail below, statements exist that require the evaluation of the second 

L sub-statement whereas on the other hand, there are also statements where 

=" 20 evaluation of the second sub-statement is not necessary in each case. 

Q 

When the first and/or the second sub-statement is evaluated in steps 400, 420, 
an evaluation success result is determined if evaluation succeeds or a 
distinguished value is returned if evaluation fails. In the following discussion, 
25 the distinguished value is noted "none". 

The provision of a distinguished value in addition to the set of possible 
evaluation success results is called bi-valuation. 



30 The bi-valuation technique makes it possible to combine imperative and 
declarative statements in one programming language. Basically, both 
imperative and declarative statements are evaluated when executed and 
either return "unit", a value, or "none". The value "unit" is returned for 
imperative statements since imperative statements always succeed. A value 
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is returned for declarative statements which succeed, and for declarative 
statements which fail return "none". 

It is therefore possible to combine both kinds of statements using so-called 
imperative connectors, like "Then" or "Else" having semantics that are based 
on the evaluation of the statements. Conditional, imperative, declarative 
statements and imperative connectors are described below in more detail. 
Further, it is demonstrated how imperative connectors are used for mixing 
statements. 

In the following, s and s, denote one or more imperative and/or declarative 
statements combined together by imperative connectors. The term 'to 
evaluate s' means 'to execute the statements in s and return the evaluation of 
the last statement in s'. Expressions like e, e-, can be literal constants, 
variables or basic operations like e + e,e*e. 

Conditional statements, or if-then-else statements, are noted 

if (e) then (s x ) else (s 2 ) 
w here e is a boolean expression. Depending on whether e evaluates to true 
or false, s 1 or s 2 is evaluated, respectively. 

As opposed to declarative statements, imperative statements always succeed, 
and evaluate to "unit". One example is the assignment, noted x.=e, where x is 
a variable identifier and e is an expression. It assigns the result of the 
evaluation of e to x. Another example is the closure loop, noted *(s). The loop 
ends when s evaluates to "none". Its semantics is as follows: 

if (s != none) then * (s) else unit 

Declarative statements are based on conditions. The evaluation of a 
declarative statement returns a value if the condition(s) is verified, "none" 
otherwise. Examples are rules, ordered action systems and unordered action 
systems. 
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The Rule is noted e -> s where condition e can be a boolean or a pattern- 
matching expression. If the condition is verified, meaning that the pattern has 
been matched or that the boolean expression has evaluated to true, then the 
rule fires, triggering the evaluation of the right hand side s. Rules are 
5 commonly used in rewriting systems by combining them in constructs similar 
to action systems. 

The (ordered) action system is noted [ | s h s 2 , s n \] and can be compared 
with a powerful Switch construct. It is used to combine rules. The action 

10 system evaluates them one by one until it finds one that does not evaluate to 
"none", i.e. a rule which fires and that has right hand side statements that do 
not evaluate to "none". The action system itself returns the result of the 
evaluation of these statements. Action systems can also contain an 
imperative statement in the last position which will act as a default case since 

15 imperative statements always return "unit". 

The unordered action system is noted { | s 7 . s 2 , s n \ } and does not 
guarantee the order of evaluation of rules, i.e. the order of declaration has not 
semantic meaning. 

20 

There are three imperative connectors which make it possible to mix 
imperative and declarative statements. An example set of imperative 
connectors is given below: 

25 The sequencing operation ";" separates instructions that are to be executed in 
sequence. 

Si ; s 2 ; ... ; s n 

will execute every statement and return the evaluation of s n . 

30 The concurrent operators || A and || v separate instructions that are to be 
executed concurrently. They have respectively logical-And-like and logical-Or- 
like semantics. Basically, s* || A s 2 concurrently evaluates s? and s 2 returning 
"none" when at least one of the s, evaluates to "none"; "unit" is returned when 
both operands evaluate to "unit". s 1 \\ v s 2 behaves in the following way: it 

35 concurrently evaluates si and s 2 returning "unit" when at least one of the Si 
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evaluates to "unit", and returning "none" when both operands evaluate to 
"none". A more formal definition of the semantics is provided below. 

The Else operator s 7 Else s 2 evaluates s 7 . If s 7 evaluates to "none", then s 2 is 
5 evaluated. The semantics is as follows: 

var v f = Si. if (v f == none) then s 2 else v f . 

v f \s a fresh variable, i.e. doesn't occur in the current context nor in s 7 or s 2 . 

The Then operator s 1 Then s 2 evaluates s 7 . If s 7 does not evaluate to "none", 
10 then s 2 is evaluated. The semantics is as follows: 

if (si ! = none) then (s 2 ) else (none) . 

The Or operator s ? Or s 2 evaluates s 7 . If s 7 evaluates to "none", the evaluation 
of s 2 is returned. If s 1 evaluates to "unit", s 2 is still evaluated but "unit" is 
£ 15 returned, no matter what s 2 evaluates to. The semantics is as follows: 

if ( Sl == none) then (s 2 ) else(s 2 ; unit). 

The And operator s 7 And s 2 evaluates s 7 . If s 7 evaluates to "unit", the 
evaluation of s 2 is returned. If s 7 evaluates to "none", s 2 is still evaluated but 
M= 20 "none" is returned. The semantics is as follows: 

Jjj if (s x I = none) then (s 2 ) else (s 2 ; none) . 

ru 

For operators And, Or, || A and || v , s 1 and s 2 have to evaluate to "unit" or "none", 
meaning that they have to be imperative expressions. 

25 

Some introductory examples are now provided to get familiar with the notation, 
and then the expressiveness brought by the technique is demonstrated with 
more complex examples. Variables / and stn are supposed to be respectively 
of type Integer and String. 

30 

A simple sequence is made of an assignment statement followed by a "while" 
loop containing a rule: this loop increments /'until it reaches 10. 

i :=0; 

35 * ( (i < 10) -> i := i + 1) 
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In an action system containing a rule, a nested action system is made of rules 
and an expression: 

CI 

(i<5) -> (strl := 'cir' ; 50 - 3), 
[| 

(i == 100) -> 'abed' , 
(i == 200) -> 'efgh' 

|], 

3.1415 

|] 

If / is less than 5, then strl is assigned the string 'cir' and the action system 
returns 47. Otherwise, if / is equal to 100 or 200, the action system 
respectively returns strings 'abed' or 'efgh'. Otherwise, it returns 3.1415. This 
last expression acts as a 'default' case. If it were not present and if / was not 
previously assigned a value less than 5 or equal to 100 or 200, the action 
system would have evaluated to "none". 

It is to be noted that action system components do not necessarily contain a 
simple expression like 50-3 or 'abed' as the last statement. They can also 
contain imperative expressions; in that case, the action system returns "unit". 

The next more complex example makes use of the pattern matching features 
described above. Basically, pattern matching expressions can be used in 
place of boolean expressions in the left hand side of rules; they enable the 
recognition of patterns and extraction of parts of a data structure. A pattern 
matching expression evaluates to true if the subject matches and then the rule 
fires. Otherwise it evaluates to false and the rule returns "none". 

In the present example, some structural data about an XML file stored in string 
variable strl are extracted. To this end, several numeric variables are created 
which will count: 

nb_open_tags number of openings tags 

nb_close_tags number of closing tags 

nb_emp-tags number of empty tags 



-31- 



nb-prefixed_tags number of prefixed tags (the prefix represents a 
namespace) 

nb_xrce_tags number of tags having the name 'xrce' 

nb_other_tags number of tags which do not have a prefix and are 

not labeled 'xrce' 

The first three tests identify the kind of the encountered tag, i.e. opening, 
closing, empty, whereas the three others examine the content of that tag. 
Since the last three tests are independent from the previous ones and relevant 
only when a new tag is encountered, the tests are split in two action systems 
combined with a Then connector. The variable tags is a string in which each 
tag name is appended. When all tags have been tested, the results are 
displayed. 



*( 

[| 

strl #?++%' <' ++ ?str2 ++ %' >' ++ ?strl -» 

nb_open_tags := nb_open_tags+l , 
strl #?++%' </' ++ ?str2 ++ %' >' ++ ?strl -» 

nb_close_tags := nb_close_tags+l , 
strl #?++%' <' ++ ?str2 ++ %'/>' ++ ?strl -> 

nb_emp_tags := nb_emp_tags+l 

II 

Then 
[| 

str2 #?++%' :'++?-> 

nb_pref ixed_tags := nb_j?ref ixed_tags + 1, 
str2 # %' xrce' — > nb_xrce_tags := nb_xrce_tags + 1, 
nb_other_tags := nb_other_tags + 1 

|] 

Then 

(tags := tags + str2) 

) ; 

print {' number of opening tags :' +str (nb_open_tags) ) ; 

print ( 'number of closing tags :' +str (nb_close_tags) ) ; 

print (' number of empty tags :' +str (nb_emp_tags) ) ; 

print { 'number of prefixed tags :' +str (nb_pref ixed_tags) ) ; 

print ( 'number of xrce tags :' +str (nb_xrce_tags) ) ; 

print ( 'number of other tags :' +str (nb_other_tags) ) ; 

print (tags) 



In this example, an action system, i.e. a declarative statement, is composed 
with another action system and with an assignment instruction, i.e. an 
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imperative statement, and the three are nested in a closure loop, i.e. an 
imperative statement. 



To illustrate the compactness and readability provided by the proposed 
5 technique, the same program coded with only the closure loop and if-then-else 
statements is presented in the following. For simplicity purposes, it is 
assumed that boolean expressions in conditions can be replaced by pattern- 
matching expressions. 



*( 

if (length (strl) > 0) then ( 

if (strl #?++%' <' ++ ?str2 ++ %' >' ++ ?strl) then ( 
if (str2 #?++%' :'++?) then ( 
nb_open_tags : = nb_open_tags + 1 ; 
nbjpref ixed_tags : = nb_pref ixed_tags + 1 

) 

else ( 

if (str2 # %' xrce' ++ ?) then ( 
nb_open_tags : = nb_open_tags + 1; 
nb_xrce_tags := nb_xrce_tags + 1 

) 

else ( 

nb_open_tags := nb_open_tags + 1 ; 
nb_other_tags : = nb_other_tags + 1 

) 

) ; 

tags : = tags + str2 

) 

else ( 

if (strl #?++%' </' ++ ?str2 ++ %' >' ++ ?strl) then 

( 

if (str2 #?++%' :'++?) then ( 
nb_close_tags := nb_close_tags + 1; 
nb_pref ixed_tags := nb_pref ixed_tags + 1 

) 

else ( 

if (str2 # %' xrce' ++ ?) then ( 

nb_close_tags := nb_close_tags + 1 ; 
nb_xrce_tags : = nb_xrce_tags + 1 

) 

else ( 

nb_close_tags := nb_close_tags + 1; 
nb_other_tags : = nb_other_tags + 1 

) 

) ; 

tags := tags + str2 

) 

else ( 

if (? ++ %' <' ++ ?str2 ++ %' />' ++ ?strl) then ( 
if (str2 #?++%' ++ ?) then ( 
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nb_emp_tags := nb_emp_tags + 1; 

nb_pref ixed_tags := nb _j?ref ixed_tags + 1 

) 

else ( 

if (str2 # %' xrce' ++ ?) then ( 
nb_emp_tags := nb_emp_tags + 1; 
nb_xrce_tags := nb_xrce_tags + 1 

) 

else ( 

nb_emp_tags := nb_emp_tags + 1 ; 
nb_other_tags := nb_other_tags + 1 

) 

) ; 

tags := tags + str2 

) 

) 

) 

) 

else (none) 

) ; 

print (' number of opening_tags :' +str (nb_open_tags) ) ; 

print (' number of closing_tags :' +str (nb_close_tags) ) ; 

print ( 'number of empty_tags :' +str (nb_emp_tags) ) ; 

print ( 'number of pref ixed_tags :' +str (nb_pref ixed_tags) ) ; 

print ('number of xrce_tags :' +str (nb_xrce_tags) ) ; 

print ( 'number of other_tags :' +str (nb_other_tags ) ) ; 

print (tags) 

Using if-then-else statements, 3x3 = 9 cases have to be dealt with separately. 
In languages like C or Java, a Switch construct would have produced a more 
readable solution, but unfortunately, Switch can only be used with primary 
integer and char/byte types, and test values have to be statically defined. 



It will be appreciated that the above described technique enables the definition 
35 of basic imperative and declarative statements, the combination of both kinds 
of operations in meaningful and arbitrarily complex control structures, and the 
typing of such constructions. 



Main applications are language construction, refining control abstractions and 
40 programmation models toward more computational expressiveness, rewriting 
systems theory, classical conditional term rewriting systems, explicit 
strategies, transformation languages and systems for compilation and 
language processing, structured document transformation, tree pattern 
matching, event management, explicit or automatic document transformation 
45 systems, and others. 
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The technique provides material for building languages which are less abstract 
and more general than rewriting systems but abstract enough to simplify and 
extend general purpose programming languages. The technique could hence 
5 play an important role in the design of new transformation techniques or the 
extension of existing ones. Further, the technique may solve data and 
document interchange problems which will lead to low costs and high quality 
solutions. 

10 Moreover, the technique provides a programming language framework through 
the definition of generic syntactic constructs, their operational semantics and 
the associated formal type system. The important difficulties which underlie 
the ambitious goal of bringing together declarative and imperative 
programming styles are solved all together, in a conceptually new and generic 

15 approach. 

It will be appreciated that the bi-valuation technique enables and complements 
the symmetrical structural pattern matching technique that has been described 
above. The technique is further particular suited for supporting general typing 
20 mechanisms. Type checking improves the global reliability of programming 
languages, and provides efficient means for optimization, thus, increasing the 
runtime performance. This will be described in more detail below. 

By means of bi-valuation of programming statements, and by using imperative 
25 connectors, the design of new programming languages or the extension of 
existing programming languages are rendered possible with constructions that 
provide innovative expressiveness. Resulting languages are located at an 
intermediate level of abstraction, between declarative, functional and 
imperative languages. This kind of abstraction could play an important role in 
30 general structure transformation technologies. When building modern 
programming languages with adequate control abstraction level, the major 
difficulty is to find the best trade-off between simplicity and power, conciseness 
and expressiveness. It will therefore be appreciated that the present 
technique provides programming constructs in such a way that the constructs 
35 offer compositional capabilities. Further, connectors are provided that allow 
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the composition of such constructs with relevant semantics. Further, a sound 
type system is provided which enables to check out composition errors. 



Statement Evaluation Syntax and Operational Semantics 

5 

In the following, the syntax and semantics of the basic conditional and 
imperative constructs are described in more detail. 

In the testing operation, environment modifications are allowed during 
10 evaluation of the boolean part. This enables the use of complex operations 
with effects on context as a condition for the test: 

n-e^r'hej 

r h if ex then e 2 else e 3 -»■ T' h if e' x then e 2 elsee 3 
if true then e 2 else e 3 -» e 2 [if 1] 
if false then e 2 else e 3 — >■ e 3 [if2] 



The sequencing operator is defined as shown hereafter: 

r h ei -» I" H e[ e x ->o v 

r h ci; e 2 -+ T' h e^; e 2 * Se<1 ' e 2 e 2 



Futher, an assignment operator is provided that finally reduces to a 
distinguished value "unit". In the prior art, similar mechanisms for typing 
imperative statements exist for integrating imperative extensions in the 
20 functional framework. However, the result of such an assignment operation x 
:= e is just the result of the expression e itself: 

r h e -> T' I- e' e — K> v 

rV^T^rFT^T' [assgl] r,^h g: =e^r,s»huMt [i * sg23 



Moreover, an iterative construct is provided in the form of a closure operator, 
25 noted *(e), which allows to iterate an action e until it evaluates to a 
distinguished value "none". Thus, this action must be a declarative action, 
since applying the closure to a pure imperative action like an assignment 
would produce endless computation. This property is checked by the typing 
rules described below. The semantics of the * operator is simply defined by 
30 *(e) -> if (e! = none) then *(e) else unit [*]. 
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A closure operation, returning always the distinguished value "unit", is 
considered as a pure imperative (mono-valuated) statement. 



Declarative constructs are defined as shown hereafter: 



::=e=>e' rule 
[ | e 1t e n | ] action system (ordered) 

{ | eu e n \ } action system (unordered) 



As mentioned above, the first universal construction is the rule, constituted of a 
left-hand condition and a right-hand action executed only if the condition can 
be verified. The proposed syntax, and the following type system, allows the 
cascading of rules of the form e ? => e 2 e 3 , understood as e 1 => {e 2 => e 3 ): 
ei =>e 2 -> if (ei == true) then e 2 else none [Rule] 

In declarative environments, such rules are usually assembled in larger 
systems. The rule choice and application strategy varies a lot depending on 
the various proposed models, but most common tactics are "try rules in order" 
or "try and rule" and "iterate application as much as possible". These standard 
models, and more sophisticated tactics as well, are easily emulated by 
combining the action systems with the closure operator presented above. 

The ordered action system consists of a succession of actions to be tried in 
the given order. In the following definition, v f denotes a "fresh" variable, i.e 
with a unique name: 



n>2 [\e u ...,e n \] 

[|e|]->e [Asys2] 



\sirvf = e\. 

if ( Vf = none) , , 

then[| e2) ...,e„|] [AsyslJ 
dseu/ 



It is to be noted that this definiton implies that all actions e,, e n -i must be bi- 
valuated, i.e possibly evaluated to "none"; the last one can be mono-valuated. 
In that case the whole system becomes itself mono-valuated, since a value 
different from "none" will be finally returned. 
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Unordered action systems as similarly defined, up to the (random) choice of 
action e, among all others: 



n>2,ie{l,...,n} {fei,... ,e„|} 

{|e|}->e [Asysb2] 



\arvf = ej. 
if {vf —= none) 

then{|ei,... ,ei_i,e i+1) . 
else Vf 



n |j [Asysbl] 



One consequence of this definition is that here, all actions must be bi-valuated, 
in the sense given above. Such an action system specifies permutation 
equivalent rule collection, allowing great perspectives for run-time 
optimizations. Moreover, it allows the programmer to avoid producing over- 
specified code, making the code more understandable to external code 
reviewers or maintainers. 

Turning now to the imperative connectors, the terminology "imperative 
connector" has been chosen by reference to the so-called "Boolean 
connectors", in order to underline the similarity. In both cases, values are bi- 
valuated. But the present, more subtle approach to the valuation domains 
allows to handle several data sets. 



The first useful connector is the well-known sequence ";" already presented. 

Another useful set of operators are concurrent execution (binary) operators, 
noted e 1 || A e 2 and e 1 || v e 2 , and also e 1 ||* e 2 for both, equipped with the 
following interleaving semantics: 

rhej-H-hej ri-e 2 ->r'he' 2 
r H ei |[*e 2 -* I* h ei ||*e 2 T h e x \\*e 2 -+ F h e x ||*e 2 lFarRJ 



The first operator || A , besides its concurrent semantics, behaves like a logical 
"and", commonly noted a, with respect to the management of the bi-valuation: 
unit j | e 2 — j-e 2 [Parlaj none|| e 2 e 2 ; none [Parlb] 
e x jj A none -> e a ; none [Parle] ei || A unit -> ei [Parld] 
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With || v , the equivalent "or" behavior, commonly noted v, is expressed: 

unit jj V e 2 — >■ e 2 ;unit [Par2a] none |j v e 2 -4- e 2 [Par2b] 
ei || v none e x [Par2c] e x jfunit — > e^unit [Par2d] 

This definition describes a simple concurrent semantics, that can be extended 
5 to a wider scope. The important point here is to define this concurrent 
composition as a bi-valuated statement consistent with the global framework. 

Besides concurrent imperative connectors, there are also provided sequential 
imperative connectors, Then, Else, And and Or. 

10 

Then and Else are defined by: 

e 1 Then e 2 -> if (e 7 != none) then e 2 else none [Then] 

e 1 Else e 2 -> var v f =e 1 . if (v f == none) then e 2 else v f [Else] 

15 

Vf is a fresh variable, i.e. doesn't occur in the current context nor in e 1 or e 2 . 
The following And and Or operators are quite similar, except that they impose 
the evaluation of both operands whatever result is computed. Another 
difference is that values computed by both operands can only range over {unit, 
20 none}. In that sense, e 1 and e 2 are imperative expressions: 

e, And e 2 -> if (e* != none) then e 2 else (e 2 ; none) [And] 
6j or e 2 -> if (e, == none) then e 2 else (e 2 ; unit) [Or] 

25 Type System 

A minimal, formal, type system that illustrates and enables the use of the 
constructs is described hereafter. This type system is based on a subtyping 
relation using inclusion polymorphism brought by a non-discriminating union 
30 type constructor. An example of a type hierarchy is shown in FIG. 5. 
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The type system introduces other relevant tools, when required, to known 
techniques for building type systems. It is described through "typing 
judgments" logically organized by means of "typing equations". 

The typing judgement y > e : r states that expression e has type t in the typing 
context y. The notion of y > t** V asserts that type t is a sub-type of type f and 
a more original judgement y > e :: r, says that the expression e has minimal 
type t. Formally, this last relation is characterized by the following property: 
(Minimal type) j>e::t iff W, y>e:t' =» 7 t> t 4 tf 



This notion of minimal type is useful in order to avoid overgeneralized 
inferences due to the so called subsumption rule (see [Sub]), while preserving 
the convenience of subtyping mechanism. The notation y, x : t > ... expresses 
that the fact that "x is a variable of type f is registered in the typing context. 
More precisely, y, x : Ms a typing context f such that f = y\j {xr}. The 
following rules define the reflexive and transitive subtyping relation for all 
well-formed types t, V, t h t 2 , t 3 and the typing context y: 

7 > ti 13 

2±liii [Min] 7>C:< T*'-*'' [Sub] 

1***** [U3] 
7>t^*i|< 2 1 J 



Rules for defining well-formedness conditions on types will not be shown, and 
types are supposed well formed in all following definitions. An important type 
constructor is the non-discriminating union which provides inclusion 
polymorphism. 



Basic typing of literals and variables is defined by the following axioms: 
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0D>n::int [Num] 0 > s :: string [Str] f,x:tt> x ::t [Var] 
0 1> trae :: bool [Booll] 0 > false :: bool [Bool2] 
0E> none:: None [None] 0 > unit :: Unit [Unit] 



Operators are typed by: 



*e {+,*,-,/} 



7 > ei : int 7 > e 2 : int d j>e 1 : string 7 > e 2 : string 

7>e 1 *e 2 ::int 7 t> ei 4- e 2 :: string 

7 E> ei : i 7 > e 2 : *' ^ , 7 j> gi : t f>e 2 :t 

7 > d == e 2 :: bool ^ 7 > = e 2 :: bool 1 

7 E> e : bool 7 > e x :: ti 7 > e 2 :: t 2 x <£ dom(7) 7 D> e x : f 7,e 1 :*>e 2 ::< 2 
7>if e then ei else e 2 ::f x |i 2 7 > varx = e!.e 2 :: t 2 



It is to be noted that [Eq,Neq] do not impose operands to have the same 
common type. That is, equality comparisons are applicable to every kind of 
data. 



10 Other basic constructs can be typed through: 

7 > ei : UnitjNone 7>e 2 ::i 2( . , f>x::t 7>e:< ri , 7 > e :: UnitiNone r 
7>e i; e 2 ::^ ^ 7 > « := e :: Unit [ASSg] 7 »»(«):: Unit [C1 ° S] 

Concurrent connectors are always bi-valuated imperatives: 

[ParAnd] [ParOr] 
7 O ei :: Unit|None 7 1> e 2 : Unit|None 7 E> e x :: UnitjNone 7 o e 2 :: Unit|None 
1>e 1 || A e 2 ::Unit|None 7>ej || v e 2 ::Unit|None 

15 

The following equations achieve very precise type control for "and-like" 
concurrence: 

7>ei:Unit 7 > e 2 : Unit 

rr^ -— [ParAndl] 

7 > ei || e 2 :: Unit 1 J 

7 > ei : None 7 > e 2 : UnitiNone r 

rrx ^ [ParAnd2] 

7 > ex e 2 :: None 



20 Similarly, for "or-like" concurrence: 
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7 t> ei :None T >e 2 :None 
7 1> ei || e 2 :: None 

7 > ei : Unit 7 > e 2 : Unit|None 7 > «i • None|Unit 7 >e 2 :Unit [par0r3] 

7 1> ei || v e 2 :: Unit 7 > ei |fe 2 :: Unit 



Sequential connectors are defined by, for some t, t\ 

7 > ei :: Unit|None 7 > e 2 :: t j>e 1 ::f|None 7t>e 2 ::f . 

7 > ei Then e 2 :: <|None 1 6nj 7 > ei Elsee 2 " * \t' 

7 1> d :: Unit|None 7 > e 2 :: UnitlNone 7 > «i " Unit|None 7 > e 2 :: UnitjNone 

7 > ei And e 2 :: UnitjNone 1 J 7 t> e x Or e 2 :: Unit|None 



Beyond these last two equations, as for concurrent connectors, much more 
precise type checking is provided in order to detect composition errors: 

7 > d : : None 7 E> e 2 : Unit|None 7 > e t : Unh|None 7 t> e 2 :: None ^ 

7 > ei And e 2 :: None 1 n 7 O ei And e 2 " None 

7t>e 1 ::Unit 7 > e 2 :: Unit 
7 > d And e 2 :: Unit 

7 1> ei :: Unit 7 > e 2 : Unit|None 7 > ei : Unit|None 7 1> e 2 :: Unit 

7>ei Ore 2 ::Unit L J 7 > ei Ore 2 :: Unit 

7 > ei :: None 7 > e 2 :: None 
7 > ei Or e 2 :: None 



10 The relevance of the typing approach described above with respect to the 
semantics of the language constructs described above is now demonstrated in 
more detail. 



The soundness property is to prove that a well typed construct cannot produce 
15 an error during evaluation. More precisely, it establishes the conservation of 
the well typed property: any well typed expression remains well typed over ail 
possible computation steps. One preliminary step is to define a logical relation 
between the typing context and the execution environment: 

20 The execution environment r is conform with respect to the typing context y 
(noted ylhT): 

7 lhT iff Var w er, f>x::t A ®>v::t 
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In the following, e is understood as a non-reduced syntactic expression. The 
type is preserved during reduction: 



The proof presents no particular difficulty; it uses an induction on the structure 
of e. 

The completeness property states that all derivations, i.e. computation steps, 
defined by the operational semantics is covered by the type control 
mechanism. Completeness is defined by: 

{7>e :i 
7 t> e' : * 
7H-F 

As for the preservation of type, the proof presents no particular difficulty; it 
uses an induction on the structure of e. 

Using the foregoing specification, the invention may be implemented as a 
machine (or system), process (or method), or article of manufacture by using 
standard programming and/or engineering techniques to produce 
programming software, firmware, hardware, or any combination thereof. 

Any resulting program(s), having computer-readable program code, may be 
embodied within one or more computer-usable media such as memory 
devices or transmitting devices, thereby making a computer program product 
or article of manufacture according to the invention. As such, the terms "article 
of manufacture" and "computer program product" as used herein are intended 
to encompass a computer program existent (permanently, temporarily, or 
transitorily) on any computer-usable medium such as on any memory device 
or in any transmitting device. 

The invention has been described with reference to particular embodiments. 
Modifications and alterations will occur to others upon reading and 




r h e ->- r' h e' 
7 > e' : t 
7ll-r 
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understanding this specification taken together with the drawings. The 
embodiments are but examples, and various alternatives, modifications, 
variations or improvements may be made by those skilled in the art from this 
teaching which are intended to be encompassed by the following claims. 
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